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We formalize some basic properties of Fourier series in the logic of ACL2(r), which is a variant of 
ACL2 that supports reasoning about the real and complex numbers by way of non-standard analysis. 
More specifically, we extend a framework for formally evaluating definite integrals of real-valued, 
continuous functions using the Second Fundamental Theorem of Calculus. Our extended framework 
is also applied to functions containing free arguments. Using this framework, we are able to prove 
the orthogonality relationships between trigonometric functions, which are the essential properties 
in Fourier series analysis. The sum rule for definite integrals of indexed sums is also formalized by 
applying the extended framework along with the First Fundamental Theorem of Calculus and the sum 
rule for differentiation. The Fourier coefficient formulas of periodic functions are then formalized 
from the orthogonality relations and the sum rule for integration. Consequently, the uniqueness of 
Fourier sums is a straightforward corollary. 

We also present our formalization of the sum rule for definite integrals of infinite series in 
ACL2(r). Part of this task is to prove the Dini Uniform Convergence Theorem and the continuity 
of a limit function under certain conditions. A key technique in our proofs of these theorems is to 
apply the overspill principle from non-standard analysis. 


1 Introduction 

In this paper, we present our efforts in formalizing some basic properties of Fourier series in the logic 
of ACL2(r), which is a variant of ACL2 that supports reasoning about the real and complex numbers 
via non-standard analysis JUlIll. In particular, we describe our formalization of the Fourier coefficient 
formulas for periodic functions and the sum rule for definite integrals of infinite series. The formalization 
of Fourier series will enable interactive theorem provers to reason about systems modeled by Fourier 
series, with applications to a wide variety of problems in mathematics, physics, electrical engineering, 
signal processing, and image processing. 

We do not claim to be developing new mathematics. However, as far as we know the mechanized 
formalizations and proofs presented in this paper are new. The research contributions of this paper are 
twofold: a demonstration that a mechanized proof assistant, in particular ACL2(r), can be used to verify 
properties of Fourier series; and infrastructure to support that activity, which we expect to be reusable 
for future ACL2(r) verifications of continuous mathematics. Our formalizations presented in the paper 
assume that there exists a Fourier series, i.e., a (possibly infinite) sum of sines and cosines for any 
periodic function. Future work could include proving convergence of the Fourier series for any suitable 
periodic function. 

The proofs of Fourier coefficient formulas depend on the orthogonality relationships between trigono¬ 
metric functions and the sum rule for integration of indexed sums. A key tool for proving these prop¬ 
erties is the Second Fundamental Theorem of Calculus (FTC-2). Cowles and Gamboa [5I| implemented 
a framework for formally evaluating definite integrals of real-valued continuous functions using FTC-2. 
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However, their framework is restricted to unary functions, while formalizing Fourier coefficient formulas 
requires integration for indexed families of functions fn{x), which we represent as f{x,n). We call such 
n a free argument. Hence, we extend the FTC-2 framework of Cowles and Gamboa to apply to functions 
with free arguments. We call the extended framework the FTC-2 evaluation procedure. One may expect 
the usual ACL2 functional instantiation mechanism to apply, by using pseudo-lambda expressions |[T] to 
handle the free arguments. However, in ACL2(r) there are some technical issues and restrictions on the 
presence of free arguments in functional substitutions, which make functional instantiation not trivial [4 |. 
We describe these issues in detail and show how we deal with them in Section lU Once the FTC-2 eval¬ 
uation procedure is built, we can use it to prove the orthogonality relationships between trigonometric 
functions. The sum rule for definite integrals of indexed sums is also formalized by applying the FTC-2 
evaluation procedure along with the First Fundamental Theorem of Calculus (FTC-1) and the sum rule 
for differentiation. The Fourier coefficient formulas for periodic functions are then verified using the 
orthogonality relations and the sum rule for integration. Consequently, the uniqueness of Fourier sums is 
a straightforward corollary of the Fourier coefficient formulas. 

The other main contribution of our work is the formalization of the sum rule for definite integrals 
of infinite series under two different conditions. This problem deals with the convergence notion of a 
sequence of functions. We consider two types of convergence: pointwise convergence and uniform con¬ 
vergence. Our formalization requires that a sequence of partial sums of real-valued continuous functions 
converges uniformly to a continuous limit function on the interval of interest. We approach this require¬ 
ment in two ways, corresponding to two different conditions. One way is to prove that if a sequence of 
continuous functions converges pointwise on a closed and bounded interval, then it converges uniformly 
on that interval, given that the sequence is monotonic and the limit function is continuous. This is known 
as the Dini Uniform Convergence Theorem IITSl . Another way is to prove that if a sequence of continuous 
functions is not required to be monotonic but converges uniformly to some limit function on the interval 
of interest, then the limit function is also continuous on that interval. A key technique in our proofs for 
both cases is to apply the overspill principle from non-standard analysis |0[l3l. Thus, we also formalize 
the overspill principle in ACL2(r) and apply this principle to prove Dini’s theorem and the continuity of 
the limit function as mentioned. 



Figure 1. Overview of the formalization of the Fourier coefficient formulas and the sum rule for definite 
integrals of infinite series. 

Figure 1 gives an overview of the work presented in this paper. The remainder of the paper is 
organized as follows. Section [previews some basic notions of non-standard analysis in ACL2(r) that we 
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use later in the paper. Section [previews two versions of the Fundamental Theorem of Calculus that we 
extend to support our Fourier series formalization. Section [^describes the FTC-2 evaluation procedure 
as an extended framework for applying FTC-2 to functions with free arguments. The formalization of the 
orthogonality relations for trigonometric functions and the sum rule for definite integrals of indexed sums 
are described in Sections]^ and [^respectively. The formalization of the Fourier coefficient formulas and 
the uniqueness of Fourier sums are described in Section]^ The preceding results apply to finite series, 
but as we look ahead to dealing with infinite Fourier series, we take a step in Section which presents 
our formalization of the sum rule for definite integrals of infinite series. Finally, Section [^concludes the 
paper and points out some possible future work. 

2 Basic Non-Standard Analysis Notions in ACL2(r) 

Here we review basic notions of non-standard analysis in ACL2(r) that are used in the remainder of this 
paper. All notions introduced here are considered non-classical, while functions whose definitions do 
not depend on any of these notions are classical. Let x be a real number. 

• A primitive notion is that x is standard, which intuitively means that x is a “traditional” real number. 
In particular, x is standard if it can be defined. For example, 1, -2, 3.65, K, e^, and s/l are sfandard. 
A nafural number is considered sfandard if if is finife, ofherwise if is non-sfandard. We will refer 
fo fhe sfandard notion of nafural numbers when sfafing fhe overspill principle in Secfion We 
feel free fo relativize our quantifiers. For example, ...” means “for all sfandard n ...”, and 

...” means “fhere exisfs non-sfandard n ...”. 

• X is i-small (infinitesimal) iff |x| < r for all positive sfandard reals r. 

• X is i-large iff \x\ > r for all positive sfandard reals r. 

• X is i-limited (finite) iff |x| < r for some positive sfandard real r. 

• X is i-close («) fo a real y iff (x — y) is i-small. 

• Suppose X is i-limited. Then standard-part(x), or simply sf(x), is fhe unique standard real 
fhaf is i-close fo x. 

3 Fundamental Theorem of Calculus 

This secfion reviews fwo versions of fhe Fundamenfal Theorem of Calculus fhaf we need fo exfend 
fo functions wifh free argumenfs, as parf of our Fourier series formalizafion. The fwo versions are 
sometimes called fhe Firsf and Second Fundamenfal Theorem of Calculus. 

First Fundamental Theorem of Calculus (FTC-1): Lef / be a real-valued continuous function on 
the interval [a,b\. We can then define a corresponding function g(x) as follows: g(x) = f{t)dt. Then 
g'(x) =/(x) for all xG [a,b]. 

Second Fundamental Theorem of Calculus (FTC-2): If / is a real-valued continuous function on 
[a,b] and g is an antiderivative of / on [a,b\, i.e., g'(x) = f(x) for all x G [a,b\, then 

[ f(x)dx = g(b)-g{a). 

J a 

In the next two sections, we extend FTC-2 to functions with free arguments and apply it to prove 
the orthogonality relations of trigonometric functions, respectively. The extension of FTC-1 and its 
application to the sum rule for definite integrals of indexed sums is described in Section [^ 
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4 FTC-2 Evaluation Procedure 

This section describes how we apply the FTC-2 theorem to evaluate definite integrals of real-valued 
continuous functions / in terms of their antiderivatives g, even when / and g contain free arguments, 
that is, arguments other than the variable with respect to which we perform integration or differentiation. 
In particular, we extend the existing FTC-2 framework ||5l to functions with free arguments, and call the 
extended framework the FTC-2 evaluation procedure. This procedure consists of the following steps: 

• Prove that / returns real values on [a,b]. 

• Prove that / is continuous on [a,b]. 

• Specify a real-valued antiderivative g of f and prove that / is the derivative of g on [a,b\', i.e., 
prove that g returns real values and g'{x) = f{x) for all x G [a,b\. 

• Formalize the integral of / on [a,b\ as the Riemann integral. 

• Evaluate the integral of / on [a,b\ in terms of g by applying the FTC-2 theorem. 

The first two steps are trivial in comparison to the last three. In the following subsections, we describe 
the challenges manifest in the last three steps and how we tackle them. 

4.1 Automatic Differentiator 

In order to apply the FTC-2 evaluation procedure to evaluate the definite integral of a function /, we 
need to specify and prove the correctness of a real-valued antiderivative g of /. The specifying task 
can be done by appealing to a computer algebra system such as Mathematica ifT^ . Notably, we must 
mechanically check in ACL2(r) that / is indeed the derivative of g. Fortunately, we don’t have to prove 
this manually for every function. An automatic differentiator (AD) implemented by Reid and Gamboa 
ini |7]| symbolically computes the derivative / of the input function g and automatically derives a proof 
demonstrating the correctness of the differentiation, i.e., automatically proves the following formula: 

/w =» 

x-y 

for all X and y in the domain of g such that x is standard, x ss y, but x For example, the user can 
employ the AD to prove that /(x) = ncos(nx) is the derivative of g(x) = sin(?ix) with respect to x, by 
calling the macro defderivative with the input function g as follows: 

(defderivative sine-derivative 
(acl2-sine (* n x))) 

The following theorem is then introduced and proved automatically: 

(defthm sine-derivative 


(implies (and (acl2-numberp 

x) 



(acl2-numberp 

(* n 

x)) 


(acl2-numberp 

y) 



(acl2-numberp 

(* n 

y)) 


(standardp x) 




(standardp n) 

(acl2-numberp 

n) 

(i-close X y) 

(not 

(equal x 

y))) 
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(i-close (/ (- (acl2-sine (* n x)) 

(acl2-sine (* n y))) 

(- X y)) 

(* (acl2-cosine (* n x)) 

(+ (* n 1) (* X 0)))))) 

The AD requires using the symbol x as the name of the variable with respect to which the (partial) 
derivative is computed. Notice that the hypotheses (acl2-numberp (* n x)) and (acl2-numberp 
(* n y)) in the above theorem are redundant since they can be implied from the set of hypotheses 
(acl2-numberp x), (acl2-numberp y) and (acl2-numberp n). In addition, the above theorem 
states that the derivative of sin(nx) is cos{nx){n* 1 +x*0), which indeed equals ncos(nx). This AD does 
not perform such simplifications. Nevertheless, the user can easily prove the desired theorem from the 
one generated by the macro def derivative. 

4.2 Formalizing the Riemann Integral with Free Arguments 

We formalize the definite integral of a function as the Riemann integral, following the same method as 
implemented by Kaufmann iTTl . When functions contain free arguments, this formalization encounters 
a problem with functional instantiations of non-classical theorems containing these functions. We will 
describe the problem in detail and how we deal with it. Let’s consider the following definition of the 
Riemann integral of a unary function, which uses an ACL2(r) utility, defun-std [4], for introducing 
classical functions defined in ferms of non-classical funcfions. Note fhaf defun-std defines a function 
which is only guaranteed fo salisfy ifs definilion on sfandard inpuls. 

(defun-std strict-int-f (a b) 

(if (and (inside-interval-p a (f-domain)) 

(inside-interval-p b (f-domain)) 

« a b)) 

(standard-part (riemann-f (make-small-partition a b))) 

0 )) 

The form above infroduces fhe Riemann integral of a funclion / as a classical funclion, even fhough 
if confains Iwo non-classical functions, standard-part and make-small-partitiorQ The proof 
obligafion here is fo prove fhe infegral relurns sfandard values wifh sfandard inpuls. More specifically, 
we need fo prove lhal fhe sfandard pari of fhe Riemann sum of /, for any parlifion of [a,b] wifh sfandard 
endpoinls info infinilesimal-lengfh subinlervals, refums sfandard values. This is Irue only if fhaf Riemann 
sum is limited. In facl, for a generic real-valued continuous unary function ref n, fhis limited properly 
was proven for a corresponding Riemann sum, as follows ifTTl . 

(defthm limited-riemann-rcfn-small-partition 
(implies (and (standardp a) 

(standardp b) 

(inside-interval-p a (refn-domain)) 

(inside-interval-p b (refn-domain)) 

(< a b)) 

(i-limited (riemann-refn (make-small-partition a b))))) 

*We use the non-classical function make-small-partition to partition a closed and bounded interval into subintervals 
each of infinitesimal length. 
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We are now interested in extending the above theorem for functions containing free arguments using 
functional instantiation with pseudo-lambda expressions. Unfortunately, free arguments are not allowed 
to occur in pseudo-lambda expressions in the functional substitution since the theorem we are trying to 
instantiate is non-classical and the functions we are trying to instantiate are classical; the following exam¬ 
ple shows why this requirement is necessary [di]. For an arbitrary classical function f{x), the following 
is a theorem. 

standardp{x) => standardp{f {x)) 

Substitution of A (x) .{x + y) for / into the above formula yields the formula 

standardp{x) ^ standardp{x + y) 

which is not valid, since the free argument y can be non-standard. 

Instead of using functional instantiation, we prove the limited property of Riemann sums (as dis¬ 
cussed above) from scratch by applying the following theorem. 

Theorem 1 (The boundedness of Riemann sums lITTIl ). Assume that there exist finite values m and M 
such that 

< f{t) < 44, for all t G [a,b\. 

Then the Riemann sum off over [a,b] with any partition P = {xo,xi,... ,Xh} is bounded by 

n 

m{b-a) < Y^f{ti){xi-Xi-i) <M{b-a) 
i=\ 

where ti G [x;_i ,x,], xq = a, and x„ = b. 

From Theorem proving the Riemann sum of / over [a,b] is bounded reduces to proving / is 
bounded on that interval. Given a specific real-valued continuous function /, it is usually straightfor¬ 
ward to specify the bounds of / on a closed and bounded interval. The problem becomes more chal¬ 
lenging when applying to generic real-valued continuous functions since it is impossible to find either 
their minimum or maximum. However, the boundedness of these functions on a closed and bounded 
interval still holds by the extreme value theorem. But again, this was just proven for unary functions 
O]. We also want to apply this property to functions with free arguments. Our solution at this point 
is to re-prove the extreme value theorem and consequently the limited property of Riemann sums for 
generic functions with free arguments. Since the number of free arguments is varied, it would be trou¬ 
blesome to prove the same properties independently for each number of free arguments. Indeed, we 
just need to add only one extra argument representing a list of the free arguments to the constrained 
functions and re-prove the concerned non-classical theorems. The necessary hypotheses for the extra 
argument can be added throughout the proof development. Note that non-classical theorems proven for 
the new constrained functions with only one extra argument added can also be derived for functions 
with an arbitrary number of free arguments, using functional and ordinary instantiation. (See lemmas 
limited-riemann-f-small-partition-lemma and limited-riemann-f-small-partition be¬ 
low for an example of how this works.) The question is how can we avoid the problem of the appearance 
of free arguments in functional instantiations of non-classical theorems as described above? The trick is 
to treat the extra argument in the constrained functions as a list of free arguments. Thus, no free argu¬ 
ment appears in the functional instantiations. To illustrate the proposed technique, let us investigate the 
constrained function ref n-2 below. It contains one main argument x and one extra argument arg. 
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(encapsulate 
((refn-2 (x arg) t) 

(rcfn-2-doniain () t)) 

;; Our witness real-valued continuous function is the 
;; identity function of x. We ignore the extra argument arg. 

(local (defun rcfn-2 (x arg) (declare (ignore arg)) (realfix x))) 

(local (defun rcfn-2-domain () (interval nil nil))) 

... ;; Non-local theorems about rcfn-2 and rcfn-2-domain 

) 

We then prove the extreme value theorem for rcfn-2 and consequently the limited property of 
the Riemann sum of rcfn-2, using the same proofs for the case of unary function refn existing in 
the ACL2 community books [21, file books/nonstd/integrals/continuous-function, lisp. The 
limited property of the Riemann sum of rcfn-2 is stated as follows: 

(defthm limited-riemann-refn-2-small-partition 
(implies (and (standardp arg) 

(standardp a) 

(standardp b) 

(inside-interval-p a (rcfn-2-domain)) 

(inside-interval-p b (rcfn-2-domain)) 

(< a b)) 

(i-limited (riemann-rcfn-2 (make-small-partition a b) arg)))) 

As claimed, the above non-classical theorem can also be applied to functions with an arbitrary num¬ 
ber of free arguments, using the trick we describe in the following example. In this example, the function 
f{x,m,n) contains two free arguments m and n. Then, the parameter arg in the above theorem should be 
considered as the list (list m n). Having said that, we first need to prove a lemma stating that every 
element in a standard list is standard. This can be proven easily by using def thm-std [4j. 

(defthm-std standardp-nth-i-arg 
(implies (and (standardp arg) 

(standardp i)) 

(standardp (nth i arg))) 

:rule-classes (:rewrite :type-prescription)) 

The functional instantiation with pseudo-lambda expressions can now be applied to prove the limited 
property of the Riemann sum of / as follows. 

(1) (defthm limited-riemann-f-small-partition-lemma 
(implies (and (standardp arg) 

(standardp a) 

(standardp b) 

(inside-interval-p a (f-domain)) 

(inside-interval-p b (f-domain)) 

(< a b)) 

(i-limited (riemann-f (make-small-partition a b) 
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(nth 0 arg) 

(nth 1 arg)))) 

:hints (("Goal" 

:by (:functional-instance 

limited-riemann-rcfn-2-small-partition 
(rcfn-2 (lambda (x arg) 

(f X (nth 0 arg) (nth 1 arg)))) 

(rcfn-2-domain f-domain) 

(map-rcfn-2 
(lambda (p arg) 

(map-f p (nth 0 arg) (nth 1 arg)))) 

(riemann-rcfn-2 
(lambda (p arg) 

(riemann-f p (nth 0 arg) (nth 1 arg)))))))) 

Note that the functional instantiation in the above lemma does not contain any free arguments. How¬ 
ever, this lemma constrains the two free arguments to be members of a list. In order to eliminate this 
constraint, we need a lemma stating that a list of length two is standard if both of its elements are stan¬ 
dard. Again, we can prove this using def thm-std. 

(defthm-std standardp-list 
(implies (and (standardp m) 

(standardp n)) 

(standardp (list m n))) 

:rule-classes (:rewrite :type-prescription)) 

We are finally able to prove the desired theorem as an instance of the lemma (1). 

(defthm limited-riemann-f-small-partition 
(implies (and (standardp m) 

(standardp n) 

(standardp a) 

(standardp b) 

(inside-interval-p a (f-domain)) 

(inside-interval-p b (f-domain)) 

« a b)) 

(i-limited (riemann-f (make-small-partition a b) m n))) 

:hints (("Goal" 

:use (:instance limited-riemann-f-small-partition-lemma 
(arg (list m n)))))) 

4.3 Applying FTC-2 to Functions with Free Arguments 

The FTC-2 theorem was stated and proven in the ACL2 community books for generic unary functions 
as follows Q : 

(defthm ftc-2 

(implies (and (inside-interval-p a (rcdfn-domain)) 

(inside-interval-p b (rcdfn-domain))) 
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(equal (int-rcdfn-prime a b) 

(- (rcdfn b) (rcdfn a))))) 

Again, we would like to apply this theorem for functions with free arguments via functional instanti¬ 
ation. Since this theorem is classical, free arguments are allowed to occur in pseudo-lambda expressions 
of a functional substitution as long as classicalness is preserved |4]. Through functional instantiation 
with pseudo-lambda terms, we encounter several proof obligations that require free arguments to be 
standard. Unfortunately, attempting to add this assumption to pseudo-lambda terms, e.g., (lambda (x) 
(if (standardp n) (f x n) (f x 0))), is not allowed in ACL2(r) since the terms become non- 
classical by using the non-classical function standardp, violating the classicalness requirement. To 
deal with this issue of functional instantiation, we propose a technique using an encapsulate event with 
zero-arity classical functions (constants) representing free arguments. Since the zero-arity functions are 
classical, they must return standard values. Using this technique, we can instantiate the FTC-2 theorem 
to evaluate the definite integral of a function containing free arguments in terms of its antiderivative. 
For example, suppose we want to apply the FTC-2 theorem to a real-valued continuous function f{x,n), 
where n is a free argument of type integer. Also suppose that g is an antiderivative of /. Our proposed 
technique consists of four steps as described below: 

• Step 1: Define an encapsulafe evenf fhaf infroduces zero-arify classical funcfion(s) representing 
free argumenf(s). 

(encapsulate 
(((n) => *)) 

(local (defun n () 0)) 

(defthm integerp-n 
(integerp (n)) 

:rule-classes :type-prescription)) 

• Sfep 2: Prove fhaf the zero-arity classical function(s) return standard values using def thm-std. 
(defthm-std standardp-n 

(standardp (n)) 

:rule-classes (:rewrite :type-prescription)) 

• Step 3: Prove the main theorem, modified by replacing fhe free argumenl(s) wifh fhe corresponding 
zero-arify funcfion(s) introduced in step 1. Without free argument(s), the functional instantiation 
can be applied straightforwardly. 

(defthm f-ftc-2-lemma 

(implies (and (inside-interval-p a (g-domain)) 

(inside-interval-p b (g-domain))) 

(equal (int-f a b (n)) 

(- (g b (n)) 

(g a (n))))) 

:hints (("Goal" 

:by (:functional-instance 
ftc-2 
(rcdfn 

(lambda (x) (g x (n)))) 

(rcdfn-prime 
(lambda (x) (f x (n)))) 
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(rcdfn-domain g-domain) 

... ;; Instantiate other constrained 
;; functions similarly. 

(int-rcdfn-prime 

(lambda (a b) (int-f a b (n)))))))) 

• Step 4: Prove the main theorem by functionally instantiating the zero-arity function(s) in the 
lemma introduced in step 3 with the corresponding free argument(s). 

(defthm f-ftc-2 

(implies (and (integerp n) ;; we assume the type of n is integer, 
(inside-interval-p a (g-domain)) 

(inside-interval-p b (g-domain))) 

(equal (int-f a b n) 

(- (g b n) 

(g a n)))) 

:hints (("Goal" 

:by (:functional-instance f-ftc-2-lemma 

(n (lambda () 

(if (integerp n) n 0))))))) 


5 Orthogonality Relations of Trigonometric Functions 


By applying the FTC-2 evaluation procedure, we can mechanically prove in ACL2(r) the orthogonality 
relations of trigonometric functions, which are the essential properties in Fourier series analysis. The 
orthogonality relations of trigonometric functions are a collection of definite integral formulas for sine 
and cosine functions as described below: 



sin(m 


—X sm n 

L ’ ^ 



0, m = n = t) 

L, if m = n 7^ 0 


(5.1) 



0 , ifm^n 
< L, if m = n / 0 
2L, if wi = n = 0 


(5.2) 



x)dx = 0 


(5.3) 


where x,L G M; L / 0; and m,n G N. As mentioned, these integral formulas can be proven using the 
FTC-2 evaluation procedure. Let’s consi der t he case m / n in formula ( |5.1| ); the other cases can be 
proven similarly. When m ^ n, formula ( |5.l| ) states that J^^f{x,m,n,L)dx = 0 where f{x,m,n,L) = 
sin(m|x) sin(n|x). Using the automatic differentiator, we can easily prove that the function g defined 
below is indeed an antiderivative of / when m^n: 


sin ((m —n)|x) 

{m — n)Y 


sin 


[{m + n)lx) \ 
{m + n)l j 


g{x,m,n,L) 


1 

2 
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Then, by the FTC-2 theorem, 


J f{x,m,n,L)dx = g{L,m,n,L) — g{—L,m,n,L) 


1 /sin((m —n)7r) sin ((m+ ?i)7r) \ 

2 y (m — n)^ (m + n)^ J 
= ^( 0 - 0 )-^( 0 - 0)=0 


1 /sin(—(m —n)7r) sin(—(m + n)7r)\ 

2 y (m — n)^ {m-\-n)^ J 


6 Sum Rule for Definite Integrals of Indexed Sums 


As part of the Fourier coefficient formalization, we need to formalize the sum rule for definite integrals 
of indexed sums, which is stated as the following theorem: 

Theorem 2 (Sum rule for definite integrals of indexed sums). Let {/„} be a set of real-valued continuous 
functions on [a,b], where n = 0,1,2, Then 


rb N N pb 

n=0 n=0-^<^ 

Note that /„(x) abbreviates f{x,n), which contains a free argument, n. Kaufmann IfTTl formalized 
the FTC-1 theorem for generic unary functions as a non-classical theorem. We re-prove it for generic 
functions with an extra argument added, following the method for extending the limited property of 
Riemann sums as described in Section |4.2| Then, by applying the FTC-2 evaluation procedure along 


with the extended version of FTC-1 and the sum rule for differentiation, the above theorem can be 
proven as follows: 


Proof For all x G [a,b] and n = 0,1,..., A, let 


8n{x) = [ fn{t)dt. 

J a 

By FTC-1, gn{x) = /«(x) for allx G [a,b],n = 0,l,...,N. 

By the sum rule for differentiation, {'Ln=oSn{x)y = T!^=ogn{x) = T.n=ofn{x) for all x G [a,b]. Then, 
by FTC-2, 


fb N N N 

/ L = Y. Snib) - Y, 8nia) 

n—0 n—0 n—0 


N f-b ^ pa ^ pb 

= Y fn{t)dt-Y / fn{t)dt=Y / fn{x)dx 


n—0'' 


n—O'^ 


n—0'' 


□ 


7 Fourier Coefficient Formulas 

From the orthogonality relations and the sum rule for integration, the Fourier coefficients of periodic 
functions can be stated as follows: 







46 


Fourier Series Formalization in ACL2(r) 


Theorem 3 (Fourier coefficient formulas). Consider the following Fourier sum f{x)for a periodic func¬ 
tion with period 2L: 

\7 

cos(u—; 


N 

L 

n—\ 


Then 


1 


+ f7„sin(n^x)^ 

(7.1) 

dx. 

(7.2) 

—x)dx, 

(7.3) 

—x)dx. 

(7.4) 


The proof of this theorem is straightforward from the orthogonality relations and the sum rule for 
integration, after applying the definition of / in (|7.11l to the Fourier coefficient formulas (|7.2|), (|7.3|), and 
Consequently, we can easily derive the following corollary. This is known as the uniqueness of 
Fourier sums: 

Corollary 1 (Uniqueness of Fourier sums). Let 

^ / 7t 7t 

/(x)=ao+^ ( a„cos(n—x)+f?„sin(?i—.r 


and 


n—i 


N 


g(x)=Ao + ^ (AnCos{nyx)-\-B„sm{nyX 


n—l 


Then f = g < 


do —Aq 

On =An, for all n = 1,2, ...,N 
bn = Bn, for all n = 

Proof (=^) Follows immediately from the Fourier coefficient formulas: 


I I 

ao = J{x)dx =^j ^g{x)dx = Ao, 

\ 7t 1 7 ^ ^ 

= - / f{x)cos{n—x)dx=- / g{x)cos{n—x)dx = An, 
L J-L L L J-L L 

1 K 1 K 

bn = y f{x)sm{n--x)dx = y / g{x)sm{nyx)dx 
L J-L L L J-L L 


ix = B„. 


(<^) Obviously true by induction on n. 


□ 


8 Sum Rule for Definite Integrals of Infinite Series 

Our formalization of the sum rule for integration in Section only applies to finite sums. However, 
Fourier series can be infinite. Thus, the sum rule for integration needs to be extended to infinite series; 
we do so in this section. 
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Our basic result is the following sum rule for integrals of infinite series, formalized using non¬ 
standard analysis. (We define uniform convergence below.) 

Theorem 4. Suppose that {/n(jc)} is a sequence of real-valued continuous functions whose sequence of 
partial sums converges uniformly to a continuous limit function on a given interval. Then 



( 8 . 1 ) 


for all infinitely large natural numbers Hq and 

Remark. The conclusion above is equivalenf fo fhe following formula using fhe epsilon-delta defi- 
nifion of limif |[T4l : 



We furn now fo fwo varianfs of Ibis fheorem fhaf relax ifs requiremenfs. We sfarf by recalling well- 
known formulafions of convergence in non-sfandard analysis. 

• Pointwise convergence: Suppose {/„} is a sequence of functions defined on an inferval /. The 
sequence {/„} converges pointwise fo fhe limit function f on fhe inferval I if ///(x) ss f{x) for all 
standard x £ I and for all infinilely large nafural numbers H. 

• Uniform convergence: Suppose {/„} is a sequence of funcfions defined on an inferval I. The 
sequence {/„} converges uniformly fo fhe limit function f on fhe interval I if //r(x) ss f{x) for all 
X £l (both standard and non-standard) and for all infinitely large natural numbers H. 

Clearly, uniform convergence is stronger than pointwise convergence. A sequence that converges 
uniformly to a limit function also converges pointwise to that function, but the reverse is not guaranteed. 
We meet the hypothesis of Theorem]^— uniform convergence to a continuous limit function — in two 
ways corresponding to two different conditions, as follows. Note: Only the second condition is relevant 
to Fourier series, but the first also leads to an interesting result. 

• Condition 1: A monotone sequence of partial sums of real-valued continuous functions converges 
pointwise to a continuous limit function on the closed and bounded interval of interest. 

• Condition 2: A sequence of partial sums of real-valued continuous functions converges uniformly 
to a limit function on the interval of interest. 


The following theorem ifTSl shows that Condition 1 implies the hypothesis of Theorem]^ 

Theorem 5 (Dini Uniform Convergence Theorem). A monotone sequence of continuous functions {/„} 
that converges pointwise to a continuous function f on a closed and bounded interval \a,b\ is uniformly 
convergent. 

Our proof of Dini’s theorem relies on the overspill principle from non-standard analysis 0 [TSll . 
Thus, we now discuss our formalization of this principle in ACL2(r) 113 . 

Overspill principle (weak version): Let P{n,x) be a classical predicate. Then 


Vx. G n.P{n,x)) => 3^^'k £ n.P{k,x)) . 


(8.3) 


In words, if a classical predicate P holds for all standard natural numbers n, P must be hold for some non¬ 
standard natural number k. By applying this principle, we can even come up with a stronger statement 
as follows: 


48 


Fourier Series Formalization in ACL2(r) 


Overspill principle (strong version): Let P{n,x) be a classical predicate. Then 

yx. G N.P{n,x)) ^ G N.Vm £N.{m<k^ P{m,x))^ . (8.4) 


In words, if a classical predicate P holds for all standard natural numbers n, there must exist some non¬ 


standard natural number k such that P holds for all natural numbers less than or equal to A:. (8.4 1 can be 


derived from (8.31 through a classical predicate P*{n,x) defined in terms of P{n,x) as follows: 

(defun P* (n x) 

(if (zp n) 

(P 0 x) 

(and (P n x) 

(P* (1- n) x)))) 

The proof of ( |8.4[ ) now proceeds as follows. 

1. Fix X and assume (V^'n G N.P(n,x)). 

2. Then, we can show that G N.P*{m,x)). 


3. Applying (8.31 to P*: 3~"-'^‘k G N.P*{k,x). 

4. From the definition of P*: G N.Vm G N. (m < Ac: 


■P{m,x)). 


We formalize (8.4) for a generic classical predicate P{n,x) in ACL2(r) and provide the overspill 


utility, which automates the application of (8.4i. In particular, the user needs only to define a classical 
predicate Pi and then call the overspill macro with the input Pi so that (|8.4|) will be applied to Pi 


automatically via a functional instantiation. We can thus apply the overspill principle (8.4i to prove 
Dini’s theorem as shown below. 


Proof of Theorem^ Without loss of generality, assume {/„} is monotonically increasing. We want to 
prove f{x) ^ fnix) for all x G [a,b] and for all infinitely large // G N. 

Fact: If X G [a,b] then st(x) G [a,b] (note that this is only true on closed and bounded intervals). 

(A) Since st(x) is standard and x ps st(x), /(x) ss /(st(x)) by the continuity of /. 

(B) Since st(x) is standard, /(st(x)) « ///(st(x)) by the pointwise convergence of {/„}. 

We will make the following two claims. 

Claim 1. For some non-standard Ac G N, we have: for all H <k, ///(st(x)) « ///(x). 

Claim 2. Suppose Ac G N such that fk{x) « fix). Then for all H > k, fix) ^ ///(x). 

For the moment, assume both claims. Choosing Ac according to Claim 1, then by the transitivity of 
i-close and Steps (A) and (B) above, we have /(x) ss ///(x) for all infinitely large H <k. Applying 
Claim 2 to that same Ac takes care of H > k, so we are done once we prove the claims. 

To prove Claim 1, we must find a non-sfandard Ac such that ///(st(x)) Ri ///(x) for all H <k. We first 
observe that by the continuity of {/«}, we have /„(st(x)) ps /„(x),Vx G [a,b] and \/^‘n G N. We apply 
the overspill principle — which requires a classical predicate — to the following classical predicate 
P(?i,xo,x). 

P(n,xo,x) = l/„(xo) -fnix)\ < 

n-\-1 


If xo,x G [a,b], xo is standard, and xo ~ x, then P(n,xo,x) holds for all standard n G N since /«(xo) — 
/„(x) 0 by the continuity of {/«}. Hence, by the overspill principle (8.4i, there exists a non-standard 

Ac G N s.t. P(m,xo,x) holds for all m G N and m <k. Now suppose that H is infinitely large but H <k. 
Then fnixo) « fnix) since 










C. Chau, M. Kaufmann & W. Hunt 


49 


0 < \fH{xo)-fH{x)\ < 

Let’s pick xq to be st(;c); then fH{st{x)) « fnix), concluding the proof of Claim 1. 

To prove Claim 2, by hypothesis pick k G N such that fk{x) ss f{x), and assume H > k. Then fk{x) < 
fnix) < f{x) by the increasing monotonicity of {/«}. Hence, 0 < \f{x)-fH{x)\ < \f{x)-fk{x)\ ^ 0. 
Thus, f{x) ^ fnix), which concludes the proof of Claim 2 and also the proof of Theorem]^ □ 

Dini’s theorem shows that pointwise convergence of a sequence of continuous functions on a closed 
and bounded interval also implies its uniform convergence if the sequence is monotonic and the limit 
function is continuous. Unfortunately, it is not applicable to Fourier series since Fourier series are not 
required to be monotonic. As a result, Fourier series cannot meet the requirement for our proof of Q 
from Condition 1. In fact, Fourier series can satisfy Condition 2 under suitable criteria jTOl . Then, from 
Condition 2, we need to prove that the limit function is continuous in order to meet the requirement for 
our proof of Q. This can be proven by applying the overspill principle. 

Theorem 6. Suppose that a sequence of continuous functions {/„} converges uniformly to a limit func¬ 
tion f on an interval I. Then f is also continuous on I. 

Proof The goal is to prove /(vq) ~ f{x) for all xo,x G I such that xq is standard and xq ^ x. By the 
uniform convergence of {/«}, we have /(vq) ~ fnixo) and f{x) ^ fnix) for all infinitely large // G N. 
If we can show that fnixo) ~ fnix), then we obtain our goal by the transitivity of ss. By applying 
the overspill principle in the same way as in our proof of Theorem we claim that there must exist a 
non-standard k G N s.t. fnixo) « fnix) if H < k. When H > k, we know that fnixo) ~ fkixo) (since 
they are both i-close to /(xq) by the uniform convergence of {/«}) and similarly fnix) ~ fkix)- Thus, 
hixo) ~ fkixo) ^ fkix) ~ fnix) and we are done. □ 

From Condition 2 and Theoremj^ in order to apply the sum rule for integration Q to infinite Fourier 
series, we need to prove that the Fourier series converge uniformly to limit functions. As mentioned 
above, this is provable under suitable criteria ITOl . 

9 Conclusions 

We described in this paper our extension of the framework for formally evaluating definite integrals of 
real-valued continuous functions containing free arguments, using FTC-2. Along with this extension, we 
also presented our technique for handling the occurrence of free arguments in pseudo-lambda expressions 
of functional instantiations. Using the extended framework, we showed how to prove the orthogonality 
relations of trigonometric functions as well as the sum rule for definite integrals of indexed sums. These 
properties were then applied to prove the Fourier coefficient formulas and consequently used to derive 
the uniqueness of Fourier sums as a corollary. 

We also presented our formalization of the sum rule for definite integrals of infinite series under 
two different conditions. Along with this task, we formalized the overspill principle and provided the 
overspill utility that automates the application of the overspill principle, thus strengthening the rea¬ 
soning capability of non-standard analysis in ACL2(r). Our proofs of Dini’s theorem and the continuity 
of the limit function as described in Sectionj^illustrate this capability. 

Some possible areas of future work are worth mentioning. First, the automatic differentiator needs 
to be extended to support partial differentiation. The current AD has limited support for automating 
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partial differentiation. Although we extended the AD to support partial derivative registrations of binary 
functions, this extension is still very limited for automatic differentiation. In particular, our extension 
imposes a constraint on the free argument of binary functions that either its symbolic name must be argO 
or it has to be a constant. As a result, the AD cannot be applied to expressions containing several binary 
functions with different free arguments. Our current solution in this case is to break those expressions 
into smaller expressions such that the AD can be applied directly to these smaller expressions, and 
then manually combine them to get the final result for the original expressions. Future work might 
make the partial differentiation process more automatic. Another possibility for future work is to prove 
convergence of the Fourier series for a periodic function, under sufficient conditions. 

In summary, we have developed and extended frameworks for mechanized continuous mathematics, 
which we applied to obtain results about Fourier series and an elegant proof of Dini’s theorem. We 
are confident that our frameworks can be applied to future work on Fourier series and, more generally, 
continuous mathematics, to be carried out in ACL2(r). 


Acknowledgements 

We thank Ruben Gamboa for useful discussions. We also thank the reviewers for useful comments. This 
material is based upon work supported by DARPA under Contract No. N66001-10-2-4087. 


References 

[1] ACL2: ACL2 Documentation on Lemma-Instance. See URL http://www.cs.utexas.edu/users/ 

moore/acl2/current/maiiual/index.html?topic=ACL2_LEMMA-INSTANCE 

[2] ACL2 Community Books: Available at https: //github. com/acl2/acl2 

[3] Overspill Principle Formalization Source Code; Available at https://raw.githubusercontent.com/ 
acl2/acl2/master/books/nonstd/nsa/overspill.lisp 

[4] R. Gamboa & J. Cowles (2007): Theory Extension in ACL2(r). Journal of Automated Reasoning 38(4), pp. 
273-301, doi: 10.1007/sl0817-006-9043-0 

[5] J. Cowles & R. Gamboa (2014); Equivalence of the Traditional and Non-Standard Definitions of Concepts 
from Real Analysis. In; Proc of the Twelfth International Workshop on the ACL2 Theorem Prover and its 
Applications (ACL2-2014), pp. 89-100, doi: 10.4204/EPTCS.152.8 

[6] P. Reid & R. Gamboa (2011): Automatic Differentiation in ACL2. In: Proc of the Second International 
Conference on Interactive Theorem Proving (ITP-2011), pp. 312-324, doi: 10.1007/978-3-642-22863-6_23 

[7] P. Reid & R. Gamboa (2011): Implementing an Automatic Differentiator in ACL2. In: Proc of the 
Tenth International Workshop on the ACL2 Theorem Prover and its Applications (ACL2-2011), pp. 61-69, 
doi:10.4204/EPTCS.70.5 

[8] R. Gamboa (1999): Mechanically Verifying Real-Valued Algorithms inACL2. Ph.D. thesis. The University 
of Texas at Austin. 

[9] R. Goldblatt (1998): Lectures on the Hyperreals: An Introduction to Nonstandard Analysis. Springer. 

[10] D. Jackson (1934): The Convergence of Fourier Series. The American Mathematical Monthly 41(2), pp. 
67-84, doi: 10.2307/2300327 

[11] M. Kaufmann (2000): Modular Proof: The Fundamental Theorem of Calculus. InM. Kaufmann, P. Manolios 
& J S. Moore, editors: Computer-Aided Reasoning: ACL2 Case Studies, chapter 6, 4, Springer US, pp. 75- 
91, doi: 10.1007/978-1 -4757-3188-0_6 

[12] R. Gamboa & M. Kaufmann (2001): Non-Standard Analysis in ACL2. Journal of Automated Reasoning 
27(4), pp. 323-351, doi:10.1023/A:1011908113514 



C. Chau, M. Kaufmann & W. Hunt 


51 


[13] H. J. Keisler (1976): Foundations of Infinitesimal Calculus. Prindle Weber & Schmidt. 

[14] H. J. Keisler (1985): Elementary Calculus: An Infinitesimal Approach. Prindle Weber & Schmidt. 

[15] W. A. J. Luxemburg (1971): Arzela’s Dominated Convergence Theorem for the Riemann Integral. The 
American Mathematical Monthly 78(9), pp. 970-979, doi: 10.2307/2317801 

[16] Inc. Wolfram Research (2015): Mathematica. Available at http: //www. wolfram. com/mathematica/ 



